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ABSTRACT 


I 


This  rsport  is  a saqual  to  our  aarllar  revlav  paper  Lamolna  (1977) 
on  the  equilibrium  analysis  of  netvorks  of  queues.  In  this  report  we 
review  some  approximation  results  for  networks  of  queues.  Detailed  discus- 
sion is  limited  to  results  which  can  be  rigorously  justified.  In  addition, 
we  call  attention  to  some  important  open  problems.  The  bibliography  in- 
cludes references  for  results  derived  in  a heuristic  or  informal  fashion 
and  includes  background  matarial  on  diffusion  processes. 


> 


» 


I 


i 


II 


.♦ni  I 


I .0  INTRODUCTION 


In  a previous  paper  Lemolne  (1977)  we  provided  an  overview  of  available 
results  on  the  equilibrium  analysis  of  networks  of  queues  and  we  called 
attention  to  some  Important  open  problems  In  the  area.  In  this  paper  we  re- 
view some  approximation  results  for  networks  of  queues.  Detailed  discussions 
are  limited  to  results  which  can  be  rigorously  justified.  We  do  mention,  how- 
ever, the  principal  references  for  results  derived  in  a heuristic  or  informal 
fashion.  We  also  discuss  some  important  open  problems  in  the  area  of  approxi- 
mation results  for  networks  of  queues.  Most  of  the  results  we  describe  in- 
volve Brownian  motion  and  diffusion  processes;  a diffusion  process  Is  a strong 
Markov  process  with  continuous  sample  paths.  Gonsequentlyy  the  bibliography 
also  Includes  a nun^er  of  references  on  Brownian  motion,  diffusion  processes 
and  related  topics. 

Approximation  results  are  available  for  both  open  networks  and  closed 
networks.  In  an  open  network  customers  originate  from  external  sources  and 
each  customer  eventually  leaves  the  system.  In  a closed  network  a fixed  and 
finite  number  of  customers  circulate  through  the  netxrark  and  no  arrivals  or 
departures  are  permitted.  For  open  networks  there  are  two  main  classes  of 
results,  both  derived  under  the  assumption  that  the  "traffic  intensity"  of  the 
network  Is  equal  to  or  approaching  the  value  one.  The  first  such  class  of 
results  provides  approximations,  via  diffusion  processes  with  boundaries,  for 
the  time-dependent  behavior  of  the  vector  of  queue-length  processes  at  the 
various  nodes  for  acyclic  networks  and  for  a generalized  version  of  the  net- 
work model  Introduced  In  Jackson  (1957):  In  an  acyclic  network  a customer 
can  visit  a node  only  once.  The  second  class  of  results  for  open  systems 


provides  approxiaaeions , again  via  diffusions  with  boundaries,  for  the 
equilibrium  distribution  of  the  total  waiting  time  experienced  by  an  arbi- 
trary customer  in  a general  tandem  queueing  system  whose  "traffic  Intensity" 
is  approaching  the  value  one  from  below.  For  closed  networks  of  queues  with 
exponentially  distributed  service  times  at  each  node,  approximation  results 
are  available  for  the  equilibrium  distribution  of  the  queue- lengths  vector, 
when  the  number  of  customers  in  the  system  and  the  number  of  servers  at  each 
node  are  large;  in  this  same  setting,  some  approximations  for  time-dependent 
behavior,  via  diffusion  processes  without  boundaries,  have  been  derived.  The 
results  for  open  systems  and  for  closed  systems  are  developed  under  the  assump- 
tion that  basic  system  parameters  such  as  arrival  rates  and  service  rates  do 
not  vary  with  time. 

The  approximation  results  to  which  we  have  just  referred  are  recent,  and 
some  have  yet  to  appear  in  print.  Moreover,  many  of  the  results  are  quite 
complicated.  Thus,  in  order  to  convey  the  nature  of  these  results  in  a straight- 
forward manner,  detailed  presentations  will  be  confined  to  relatively  simple 
models,  with  indications  given  for  more  general  situations. 

This  paper  is  organized  as  follows . In  Section  2 we  present  a heavy  traf- 
result  for  the  tlme'-dependent  behavior  of  the  multi-server  queue  due  to 
Iglehart  and  Whitt  (1970*»b).  This  result  is  of  interest  for  networks  because 
it  also  holds  under  fairly  weak  conditions  on  the  customer  arrival  process  and 
it  can  be  generalized  to  provide  joint  limits  for  several  facilities  in  an 
acyclic  network  in  heavy  traffic.  This  is  followed  by  a discussion  of  the  work 
of  Harrison  (1973^),  (1977)  on  approximations  for  the  waiting  time  process  for 
queues  in  tandem,  and  the  forthcoming  work  of  Reiman  (1977)  on  heavy  traffic 
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results  for  s gsnsrsllzation  of  ch«  netvork  modal  introduced  in  Jackson  (1957). 
In  Section  3 ve  present  some  results  for  closed  Markovian  networks  and  we  use 
a generalisation  of  the  classical  repairman  problem  to  illustrate  those  re- 
sults. The  results  for  the  closed  system  include  approximations  for  the  equi- 
librium distribution  duo  to  Iglehart  and  Lemoine  (1973)^  (197^)  snd  Lureau 
(197^))  snd  a diffusion  approximation  for  time-dependent  behavior  due  to 
Iglehart  and  Lalchandani  (1973) • The  diffusion  results  c£  Iglehart  and 
Lalehandanl  (1973)  were  originally  derived  by  heuristic  arguments;  however, 
using  methods  to  be  reported  in  the  forthcoming  monograph  of  Varadhan  (1977); 
these  results  can  now  be  rigorously  Justified.  Finally,  in  Section  U we  dis- 
cuss some  important  open  problems  in  the  area  of  approximations  for  networks 
of  queues . 

The  literature  on  Brownian  motion  and  diffusion  processes,  and  the  allied 
subject  of  stochastic  integrals  and  stochastic  differential  equations,  is 
quite  varied  in  scope  and  in  level  of  difficulty.  Some  references  incude  the 
following,  which  are  listed  in  approximate  order  of  increasing  level:  Cox  and 
Miller  (1905),  Karlin  and  Taylor  (1975);  Arnold  (197-);  Breiman  (I968),  Varadhan 
(1968),  Freedman  (1971);  Friedman  (1975);  (1976);  Gikhman  and  Skorokhod  (I969), 

I to  (1961),  Dynkin  (I965);  Gikhman  and  Skorokhod  (I972),  Varadhan  (1977),  McKean 
(1969),  and  I to  and  McKean  (1965)* 

Finally,  we  close  this  section  with  comments  about  approximation  results 
derived  in  a formal  setting  and  results  derived  by  Informal  approaches . The 
approximation  results  discussed  in  Section  2 and  Section  3 are  obtained  as  a 
by-product  of  rigorously  proven  theorems.  However,  while  the  rigorous  Justifi- 
cation of  an  approximation  scheme  is  always  desirable,  actually  proving  that  a 
certain  diffusion  ''approximates"  a given  process  of  interest  can  be  a very 
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difficult  affair.  Thaaa  dlfflcultlaa  not  withstanding,  the  significant 
advantage  of  tractablllty  makes  It  very  tempting  to  develop  diffusion  models 
as  approximations  for  processes  of  Interest,  even  without  providing  rigorous 
proofs.  Programs  of  this  sort  have  been  carried  out  by  several  authors. 

The  papers  of  Gaver  (1968)  and  Newell  (I966)  and  the  monographs  Newell  (1971), 
(1973)/  (1975)>  (1977)  «te  outstanding  examples  of  this  approach.  Other  in- 
teresting work  In  this  regard  Includes  McNeil  and  ^chach  (1973),  McNeil  (1973), 
Kobayashl  (197Ua,b),  Gaver,  Lehoczky  and  Per las  (1975),  and  Gaver  and  Lachoczky 
(1976a,b).  These  programs  have  been  achieved  by  combining  probabilistic  in- 
tuition with  a careful  examination  of  the  process  one  wants  to  approximate. 

In  many  Instances  the  results  obtained  appear  to  be  quite  good  and  would  cer- 
tainly seem  to  Justify  this  informal  approach  for  analyzing  complex  systems 
under  non-statlonary  conditions. 
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2 .0  OPEN  SYSTEMS 

In  this  section  we  present  some  heavy  traffic  results  for  open  systems . 

The  main  objectives  of  heavy  traffic  research  are  to  describe  unstable 

queueing  systema  and  to  approximate  stable  queueing  systems.  The  term  heavy 

traffic  was  introduced  by  Kingman  (I96I},  (I962),  (19^5)  and  referred  to 

qiieueing  systems  with  a traffic  intensity  p less  than  but  close  to  one;  in 

this  context,  see  also  Kollerstrom  (197^) • In  subsequent  work  the  notion  was 

expanded  to  include  both  single  queueing  systems  with  a traffic  intensity 

0 > 1 or  sequences  of  qtieueing  systems  with  traffic  Intensities  Co  } such 
~ n 

that  0^  1 as  n os  . A comprehensive  account  of  heavy  traffic  research 

in  queueing  theory  through  197^  can  be  obtained  from  Whitt  (1968),  Iglehart 
(1973)  and  Whitt  Cl97^)«  The  moat  important  tool  in  heavy  traffic  research 
is  the  theory  of  weak  convergence  of  probability  measures  on  complete  separ- 
able metric  spaces;  the  main  references  on  this  subject  are  Billingsley  (1963) 
and  Farthasarathy  (1967). 

Our  discxission  of  heavy  traffic  results  in  this  section  draws  upon  the 
work  of  Iglehart  and  Whitt  (I970a,b),  Harrison  (1973b),  (1977)  and  Reiman 
(1977)*  Tn  Section  2.1  we  discuss  some  work  of  Iglehart  and  Whitt  ( 1970a, b) 
on  multi-server  systems.  In  Section  2.2  we  discuss  some  work  on  single  server 
qxieues  in  tandem  due  to  Harrison  (1973^)^  (T977);  and  some  work  of  Reiman  on 
a generalization  of  the  classical  open  network  model  of  Jackson  (1957)  • 

Other  approximation  results  for  open  systems  are  developed  in  Harrison 
(1973*)  aod  Crane  (I97I),  (1973)/  (197^»l>).  The  paper  of  Harrison  (1973a) 
considers  a system  in  which  a single  assesdiler  is  making  a piece  of  equipment 
consisting  of  K sub -assemblies,  and  each  sub-assembly  arrives  at  the  asseidiler's 
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sCatloa  according  to  a ranawal  process.  This  aodal  was  ganarallzad  In  Crane 
(19T1),  (I97W))  CO  allow  more  than  one-asseabler.  In  Crane  (1973),  (197l;a) 
heavy  traffic  results  are  developed  for  some  Interesting  network  models  which 
arise  In  various  mass  transit  systems. 


2.1  Some  Heavy  Traffic  Results  for  a Multi-Server  System 

The  nailcl-server  queueing  model  considered  here  has  the  following 
structure.  The  customer  arrival  process  Is  the  superposition  of  r Indepen- 
dent  renewal  streams  and  there  are  s Independent  servers,  or  service  channels, 
with  the  arrival  process  and  the  service  channels  Independent.  Arriving  cusCo> 
aers  Join  a single  queue  and  are  served  In  order  of  their  arrival  without  defec- 
tions. Interarrlval  times  in  the  1th  arrival  channel  (or  renewal  process) 
have  mean  1/^.^  and  finite  variance  . Service  times  in  the  jth  service 

channel  are  independent  and  have  a coosaon  distribution  with  mean  l/p.  and 
2 

finite  variance  Sj  . Let  X - + . . . + (total  arrival  rata)  and 

;i  ■ + . . • + (maximum  service  rata).  The  natural  measure  of  congestion 

for  this  system  Is  p ■ x/u  . We  first  discuss  the  case  where  0 ■ L and 


INPUT  STREAMS  SERVERS 


FIGURE  1 - MULTI-SERVER  QUEUEING  SYSTEM 
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th«n  consider  a saquanca  of  such  syatams  with  traffic  intensities  Co  ) such 

n 

that  Ojj  -*  1 «•  n -»«9  . In  all  cases  wa  'All  be  concerned  with  the  time- 

depandent  behavior  of  the  stochastic  process  (Q(t),  t > o)  where  QCt)  is 
the  total  number  of  customers  waiting  for  and  receiving  service  at  rime  t . 

In  the  case  where  o * I the  queueing  system  is  unstable,  with  the  vari- 
able Q(t)  becoming  very  large  as  time  passes  In  the  sense  that  P(Q(t)  > k)  -♦  1 
as  t -*oo  for  any  positive  integer  k . Just  how  fast  this  growth  can  occur 
is  an  important  question.  Unfortunately,  the  process  (Q(t),  t > O)  is  vir- 
tually impossible  to  work  with  in  a direct  manner.  However,  when  5 ■ 1 it 
turns  out  that  the  behavior  of  this  process  can  be  approximated  by  that  of  an 
appropriate  diffusion  process,  through  which  the  rata  of  growth  can  Indeed  be 
estimated. 

The  result  we  want  to  give  is  developed  as  follows.  Let 

i-l  j-1 


and  for  n - I,  2,  ...  and  t in  fO,  1]  let 


Qn(T) 


Q(nT) 

1^72 

T n ' 


For  each  n we  ara  thus  defining 
saaq)la  paths  of  the  process  Q(*) 
Brownian  motion  process  on  [0,1] 


a random  fxmetion  on  [0,1]  based  on  the 
over  [0,n]  . Let  *(*)  denote  a standard 

. Also,  let  denote  weak  convergence 


t 
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(or  cotxvergenc*  in  distribution);  cf,  Billingsley  (1968).  With  this  setup 
the  followlxig  result  is  obtained  in  Iglekart  and  Whitt  (1970a). 


For  all  initial  vlaues  of  Q(0] 


q„(-)— > l!(-)l 


as  n 00 


The  limiting  diffusion  process  in  (1)  is  reflecting  Brownian  motion. 


From  [26]  there  are  the  following  corollaries  to  the  above  result,  which 


provide  precise  estimates  on  the  rate  of  growth  of  the  process  Q(*)  as  time 


passes.  First,  for  x>0 


lim 

t— » oa 


< 


172  - 


2«  (x)  - 1 


where  9 is  the  distribution  function  of  M(0,1)  random  variable.  Second, 


3 a (l/on^/^)  sup  Q(t) 

^ 0<t<n 


I A 

11m  P j Qjj  < x 

n-4  os 


where 


( ) 

'F(x)  » 1 - (VTr)^^  j(-l)V(2k  + 1)J  exp  - j7r^(2k  + l)^/8x^j  | . 

k«l 

Moreover,  rates  of  convergence  for  (1)  and  other  results  from  [26]  and  [2J] 
are  developed  in  Kennedy  ( 1972a ,b). 

llie  result  (1)  can  also  be  Interpreted  as  follows.  For  n large  the 
behavior  of  Q(*)  over  [0, n]  is,  in  a distribution  sense,  approximately 
that  of  fo'|n^^^|(T)  I , 0 < t < l)  ; and,  as  n -4  <»  the  process 
goes  to  standard  Brownian  motion  CB(t),  0 < t < »)  . Thus,  the  behavior 

of  the  process  tQ(t),  t > O)  can  be  approximated  by  that  of  {iTjB(t)|,  t > o) 
Hence,  we  would  expect  the  process  Q(*)  to  move  in  approximately  the  same 
direction  and  with  approximately  the  same  "speed"  as  the  reflecting  Brownian 
process  [3(*)(  . Then,  another  device  for  estimating  ctie  rate  of  growth  in 

the  process  Q(’)  is  to  use  the  first-passage  distributions  of  the  process 

!b(-)I  . 

So,  for  z > 0 let 

T »•  inf  Ct  : B(t)  > z or  B(t)  < -z)  , 

so  that  T is  the  epoch  of  first  passage  to  the  level  z by  the  process 
z 

|b(*)|  . The  Laplace  transform  of  the  distribution  of  T is  given  by 

z 

Ejexp(-0T^]  |b(0)  - oj  = l/cosh[z(29)^/^] 


9 


T » infCs  > 0 : B(s)  - 0 or  8(3)  - b)  . 

Observe  that 

> t|B(0)  - 0|  - 

for  z > u and  t > 0 . It  Is  known,  cf . Feller  (I97I)  or  Freedman  (1971), 

that 


+ 00  / 

I^(t,a)  . ^ j<5|[2kb  + b - - «([2kb  - 

k«-co( 


«([2kb  + b + a]/t^/^j  - ®([2kb  + a]/t^/^) 


An  alternate  expression  for  Ljj(t,a)  is  given  by 


oo 

I^(t,a)  =»  (Vtt)  ^ [l/(2k  + l)]exp  j-  (2k  + l)^7T^t^/2b^ 


fc-0 


X sia((2k  + l)7ra/b] 


1 

) * 


The  first  series  converges  rapidly  for  small  t xdiile  the  second  converges 
rapidly  for  large  t . 

Returning  now  to  the  multi-server  system,  we  see  that  if  Q(t)  * m then 
uhe  mean  and  the  variance  of  the  elapsed  time  until  m > m customers  are  in 
the  system  might  be  approximated  by 


/ * x2  , 2 , * vk  , k 

(m  - m)  /(T  and  (m  - m)  /2a 


(3) 


And,  the  probability  of  the  customer  population  staying  below  the  level  m* 
throughout  the  time  interval  [t,  t + t*]  might  be  approximated  by 


a 
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t 


t 


A notevorthy  feature  of  the  estimates  (2)  and  (5)  is  their  extreme  simplicity; 

2 

only  the  basic  system  parameters  , i » 1 . . . , r , and  u , 

2 ^ 
t j * 1>  • • • > s , are  needed  for  implementation. 

An  Important  direction  in  which  the  result  (1)  also  holds  is  in  specify- 
ing the  limiting  behavior  of  a sequence  of  multi-server  queueing  systems  when 

the  corresponding  sequence  of  traffic  Intensities  (o  ) . where  o ■ X /u 

u ' n n'  n ^ 

approaches  the  limit  p » 1 from  below;  that  Is^  we  are  Interested  in  approxi- 
mating the  time -dependent  behavior  of  systems  which  are  stable  but  only  just 

so.  There  will  be  different  limits  depending  on  the  rate  at  which  o * 1 

n 

as  n -» « ; the  limiting  behavior  actually  depends  on  X - u rather  than 

n n 

X /u  , but  these  are  equivalent  as  long  as  X X and  -»  ii  where  0 < X . 
a n n n 

. To  illustrate,  let  denote  the  queue-length  process  for  the 

2 

nth  system,  and  let  be  defined  for  the  nth  system  in  the  same  way 

as  cr^  for  the  single  system  above.  Let  Q*  (t)  » Q (nT)/o‘  n^^^  for  t 

in  [0,1]  . For  c in  (-  oo,  0]  let  |*(t)  » |(t)  + ct  , l.e.,  |*(  • ) 

is  Brownian  motion  on  [0,  1]  with  drift  c . Now  let 

X (t)  - I (t)  - inf  I (t  ) 

* 

0 < T <T 

Thus,  the  process  X (•)  is  the  process  | (•)  together  with  an  impenetrable 
barrier  at  the  origin.  Then,  the  appropriate  generalization  of  (1)  is  the 
followizig . 

2 2 2 

as  n -* » , where  0 < cr  < « , and 

■=  (M 
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then  as  n oa 


Qn(-)  =*»  X (.)  . 


If  c ■ 0 then  X (•)  has  the  same  distribution  as  ||(•)l  / cf.  Ito  and 
McKean  (I965),  and  we  obtain  (1)  as  a special  instance  of  (5).  The  more 
interesting  case  is  where  c < 0 ; in  this  case  the  result  (5)  says  that 

the  behavior  of  Q^( • ) can  be  approjclmated  by  that  of  Brownian  motion  with 
negative  drift  qAr  together  with  an  impenetrable  barrier  at  the  origin.  For 
more  on  this  case  see  [27]  and  the  references  therein. 

At  first  glance  it  might  appear  that  the  results  (1)  and  (5)  are  not 
relevant  for  describing  the  behavior  at  a node  (or  service  facility)  in  an 
open  network  of  queues  since  the  total  customer  input  to  a node  seldom  consists 
of  the  superposition  of  a finite  number  of  independent  renewal  streams.  However . 
the  following  weaker  condition  on  the  customer  arrival  process,  say  CA(t),  t > o) 
is  sufficient  to  insure  that  both  (1)  and  (5)  hold.  For  n ■ 1,  2,  . . . and 
T in  [0,1]  let  A^(t)  ■ [A(nT)  - nrX  I/o’  n ' where  \ and  o'  are  speci- 
fied positive  constants.  Then  if 


AJ-)— ^ !(•) 


as  n CO  , both  of  the  results  (1)  and  (5)  hold  (with  appropriate  constants 
X and  a ) . The  "central  tendency"  condition  (6)  would  be  satisfied,  for 
example,  in  the  case  where  the  process  A(«)  is  the  pooled  output  of  a finite 
nuad)er  of  independent  multi-server  facilities  in  parallel,  each  of  which  is 


15 


Is  stable,  or  In  the  case  where  A(*)  Is  the  output  of  a finite  nundier  of 


nulti-server  facilities  in  tandem,  each  of  which  is  also  stable. 


Significantly,  the  heavy  traffic  results  (1)  and  (5)  have  been  general- 


ized in  [27]  to  provide  Joint  limits  for  several  facilities  in  an  acyclic 


network,  such  as  the  system  depicted  in  Figure  2.  A sequence  of  such  net- 


works is  considered  in  [27]  with  the  traffic  intensity  at  each  node  in  the 


nth  system  approaching  the  critical  value  1 as  n -4  oa  . Multi -dimensional 


limits  are  obtained  for  the  normalized  vector  of  queue-length  processes  at 


the  various  nodes.  However,  the  multi -dimensional  processes  which  arise  as 


FIGURE  2 - ACYCLIC  QUEUEING  NETWORK 


limits  for  these  networks  are  very  complicated  functionals  of  multi-dimensional 


Brownian  motion  which  are  very  difficult  to  evaluate  in  detail.  As  a conse- 


quence, there  are  as  yet  no  computationally  tractable  approximations  which  have 


been  extracted  from  these  Joint  limits,  such  as  those  given  above  for  the 
multi-aerver  system. 

2.2  Some  Results  for  Tandem  Queues  and  for  General  Open  Networks 
We  now  discuss  some  work  of  Harrison  (19T7)  on  tandem 

queues  and  some  work  of  Reiman  (1977)  on  a generalization  of  the  classical 
network  model  of  Jackson  (1957)*  We  encourage  the  reader  to  consult  also 
the  very  interesting  reports  of  Newell  (1975)#  (1977);  see  also  Kobayashi  (197^a#b). 

The  tandem  system  consists  of  R > 1 single  server  facilities  (or  stations) 
arranged  in  series  and  a single  external  input  process;  see  Figure  3«  Customers 
arrive  at  the  first  facility  according  to  a renewal  process  and  proceed  through 
the  series  of  K stations.  Customers  receive  service  at  each  station  in  order 
of  arrival,  no  customers  defect  at  any  stage,  and  all  stations  have  unlimited 
queue  capacity. 


INPUT 

STREAM 


OUTPUT 

STREAM 


FIGURE  3 - SINGLE-SERVER  QUELTS  IN  TANDEM 
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The  laterarrival  eloas  in  the  Input  process  and  the  service  times  at 
each  station  are  mutually  Independent  sequences  of  Independent  and  Identically 
distributed  random  variables.  The  Inter-arrlval  times  are  distributed  as  a 
variable  U and  the  service  times  at  station  k (1  < k < K)  are  distributed 
as  a variable  . Let  e{u)  ■ a , Var{u)  » “ *’k 

Var(Vj^)  t »nd  assume  that  all  of  these  quantities  are 

finite.  Let  denote  the  waiting  time  (exclusive  of  service  time)  at 

station  k for  the  nth  arriving  customer,  and  let 


Now  let 


d ■ min  (a  - b.  ) 
l<k<K  “ 


It  is  well  known,  and  Indeed  quite  clear,  that  w^  converges  in  distribution 

(as  n -«<•)  to  a proper  limit  w if  and  only  if  max  b. /a  <1  , that  is 

l<k<K  ^ 

to  say,  if  an  only  if  d > 0 . ’Thus,  the  parameter  d can  be  regarded  as  the 

traffic  Intensity  of  the  tandem  system.  In  the  case  where  d > 0 the  system 
is  said  to  be  stable,  but  'In  what  follows  we  say  that  the  tandem  system  is  in 
heavy  traffic  if  d Is  positive  but  close  to  zero.  The  main  result  of 


t 


t 


t 


t 


t 


f 


f 
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R«rclsoii  (l9T3b)  provld««  « haav^r  traffic  approximation  for  the  equilibrium 
waiting  time  vector  w , generalizing  the  result  of  Kingman  (I96I)  for  the 
queue  GI/G/1  . The  main  theorem  of  [23]  shows  that  under  heavy  traffic  con- 
ditions the  vector  d w is  distributed  approximately  as  a certain  K-vector  Z 
The  random  vector  Z is  defixied  as  a certain  functional  of  (K  1)  - dimen- 
sional Brownian  motion,  and  its  distribution  depends  upon  the  underlying  inter- 
arrival and  service  time  distributions  only  through  their  means  and  variances . 
The  precise  formulation  of  the  main  result  in  [23]  is  in  terms  of  a limit 
theorem  for  a sequence  of  tandem  systems  with  d ^ 0 

The  methodology  employed  in  Harrison  (1973b)  is  similar  to  that  of  Igla- 
hart  and  Whitt  (1970a,b).  There  is,  however,  an  important  distinction  between 
the  results  of  [23]  and  the  result  obtained  in  [27],  As  noted  in  Section  2.2, 
the  paper  (27l  considers  a sequence  of  acyclic  networks  with  the  traffic  in- 
tensities at  the  various  nodes  approaching  the  critical  value  1 . The  re- 
sults of  [27]  are  concerned  with  the  time-dependent  behavior  of  queue-length 
processes,  showing  weak  convergence  to  certain  diffusion  processes  related  to 
Brownian  motion.  Such  results,  however,  do  not  address  the  problem  of  heavy 
traffic  behavior  of  equilibrium  distributions,  as  do  the  results  of  [23]. 

We  now  present  the  main  result  of  Harrison  (1973^)  as  it  related  to  the 
equilibrium  waiting  time  vector  w . The  result  is  for  a sequence  of  series 
queueing  systems  indexed  by  m > 1 . Each  system  has  K stations  and  satis- 
fies all  of  the  assumptions  given  above  regarding  the  distributions  of  inter- 
arrival an4  service  times.  In  what  follows  all  of  the  notation  introduced 
above  will  be  maintained,  except  chat  a functional  dependence  on  m will  be 
added  to  indicate  a random  variable  or  a parameter  associated  with  the  mCh 
system. 
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Th«  result  is  built  up  as  follows . It  Is  first  assumed  that  as  m oe 


d(m)  10  , 


o'a(»)  -►O’*  , 


ff.  (a)  -♦  (T.  , 1 < Ic  < K 


[a(m)  - b(m)]/d(m)  , 

where  each  of  , , , , (T^  , , . , , Is  non-negative  and 

finite.  (Note  that  necessarily  1 for  k » 1,  . . . , K as  well).  In 

addition,  it  Is  assumed  that 


Ej[U(m)]*'^®j  and  E|[Vj^(m)  ^ | 

are  uniformly  bounded  in  m and  k for  some  e > 0 . Now  let  B^(*)  , 

K + 1 

. . . B (•)  be  Independent  standard  Brownian  motion  processes  on  [0,  ■<>}  , 
For  I < k < K and  t > 0 let 


C^t)  . ffj^B^t)  - - c^t  . 


t 


I 


t 


f 


f 


f 


I 

t 

I 


t 
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Then,  for  1 < k < K let 


sup 

0<8^<  ...<Zq  <» 


end  then  put 


(7) 


Observe  that  the  random  vector  Z depends  upon  the  underlying  Interarrlval 
and  service  time  distributions  only  through  the  parameters  ir^,  , 

*1^  * * * ' ‘ write  Z « . . . , Cj^,  . . . , c^^) 

In  the  notation  we  have  established,  the  random  vector  w(m}  Is  the  equilibrium 

welting  time  vector  for  the  mth  system.  The  result  from  Harrison  (1973b)  which 
we  want  to  give  can  now  be  stated  as  follovs. 


As  a->o»  the  random  vector  w(n)  converges  In  distribution  to  the  random 

vector  Z((T.,  <t,  , . . . , o-  , c, , . . . , c_)  . 

A 1 K 1 ^ K 

The  outstanding  unsolved  problem  posed  In  [231  Is  the  explicit  determlna-  .| 

cion  of  Che  distribution  of  Z for  general  values  of  the  parameters  , j 
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o’j^,  . . , f (T^,  Cj^,  . . . , Cjj  . ic  Is  demonstrated  In  [23],  however,  than 
in  the  special  ease  where 


0 < 0-. 


or^  - . . . . o-j^ 


the  components  of  Z are  Independent,  with  the  kth  component  (I  < k < K) 

p 

having  au  exponential  distribution  with  parameter  • It  Is  not  likely, 

though,  that  Z will  have  such  a simple  distribution  for  arbitrary  values  of 

the  constituent  parameters.  That  this  Is  Indeed  the  situation  Is  borne  out 

by  recent  work  on  the  tandem  queue  modal  of  Figure  3 to  be  reported  in  Harrison 

(1977) • We  now  describe  some  of  this  ongoing  work  of  Harrison. 

With  w and  d'  defined  as  above  let 
n 


-07  t > 0 . Now  consider  a sequence  of  tandem  systems  with  d i 0 as  above, 

What  happens  is  that 


i • 


x(-)^  x(.) 


as  d i 0 , where  (X(t),  t > O)  is  a K-dlmenslonal  diffusion  process  defined 

(not  surprisingly)  as  a complicated  functional  of  multi -dimensional  Brownian 
motion.  The  process  X(*)  is  essentially  the  same  as  the  process  obtained  by 
applying  the  results  of  Iglehart  and  Whitt  (1970b)  to  the  vector  of  queue-length 
processes  at  the  various  stations  for  the  tandem  system. 
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Th«  first  area  of  recent  work  on  the  tandem  queue  model  to  be  reported 
in  Harrison  (1977)  has  been  in  the  analytical  characterization  of  the  diffu- 
sion process  %(•)  . Specifically,  a good  deal  of  effort  has  focused  on  the 

infinitesimal  generator  of  the  Markov  process  X(*)  , and  this  has  a nusdier 

of  implications  which  we  now  discuss.  (This  work  is  not  directly  related  to 
the  main  result  of  Harrison  (1973b)  since  that  paper  deals  exclusively  with 
equilibrium  distributions;  but  more  will  be  said  about  that  later  on.)  The 
state  space  of  the  process  X(*)  is,  of  course,  the  non-negative  orthant  in 
K dimensions;  moreover,  on  the  interior  of  the  state  space  X(«)  behaves 
as  a K-dimensional  Brownian  motion  with  certain  drift  coefficients  and  a cer- 
tain covariance  matrix.  The  generator  calculations  which  have  been  developed 
show  that  the  behavior  of  X(«)  at  the  boundary  of  the  state  space  is  instan- 
taneous reflection  at  an  angle  which  is  constant  along  each  boundary  surface 
but  different  for  each  surface.  For  the  case  of  two  queues  in  series  the 
angles  of  reflection  are  shown  in  Figure  h;  the  coordinates  of  the  vector  x 

X2 


FIGURE  4 - ANGLES  OF  REFLECTION  FOR  DIFFUSION  LIMIT  OF 
WAITING  TIME  PROCESS  FOR  TWO  SINGLE- 
SERVER QUEUES  IN  TANDEM 
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are  denoted  by  and  Xg  , so  that  x^  corresponds  to  the  customer  wait- 

ing time  at  the  first  station  and  Xg  to  the  waiting  time  at  the  second 
station.  The  generator  calculations  are  also  useful  in  the  following  context. 

For  almost  any  distribution  associated  with  the  process  X(*)  , such  as 

occupation- time  distributions,  transient  distributions,  etc.,  the  generator 
calculations  suggest  a corresponding  partial  differential  equation;  and  if  a 
solution  to  this  partial  differential  equation  can  be  found,  or  just  shown  to 
exist,  then  the  generator  results  can  be  used  to  show  that  this  solution  is 
unique  and  coincides  with  the  desired  distribution. 

Going  back  to  the  waiting  time  process  in  the  tandem  system,  it  has  been 
shown  that  the  diffusion  X(*)  has  a stationary  distribution  ^ , and  that 

?r  is  the  distribution  of  the  random  vector  Z given  above  as  the  weak  limit 
of  dw  as  d 1 0 . This  means  the  following.  Let  P^(x,E)  =«  P{x(t)  € E |x(0)  « x} 
for  Borel  sets  E in  the  non-negative  orthant  in  K dimensions.  Then 


^(E)  » J P^(x,E)7r(dx)  , 

E 

and  for  each  K-dimensional  vector  y 

P{Z  < y)  - w((x  ; 0 < X < y))  . 

More  significantly,  however,  a partial  differential  equation  (with  bound- 
ary conditions)  has  been  developed  for  the  density  of  the  stationary  distribu- 
tlon  TT  . Specifically,  it  has  been  shown  that  if  the  K-dimenslonal  probability 
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density  function  £ satisfies  this  partial  differential  equation,  then  it 
is  indeed  the  density  function  of  the  distribution  tt  , and  hence  the 
density  for  the  correct  heavy  traffic  approximation  to  the  equilibrium  wait- 
ing time  distribution. 

Thus,  in  order  to  completely  resolve  the  outstanding  problem  posed  in 
Harrison  (19T>b)>  it  is  necessary  to  produce  a general  solution  for  a certain 
partial  differential  equation  and  to  prove  that  this  solution  is  a probability 
density  function.  For  the  special  case  (given  earlier)  where  a a u m , . . 

A * 

> cr^  , the  corresponding  f indeed  solves  the  requisite  partial  differential 

equation.  Another  special  case  for  which  a solution  has  been  found  is  the 

2 2 ? 

following.  For  K ■ 2 suppose  that  * 0'2  ^ ^ ^ ^ ^ 

c^  a C2  = c . This  corresponds  to  deterministic  service  times  at  station  1, 
the  service  time  variance  at  station  2 equal  to  the  interarrival  time  variance, 
and  equal  service  rates  at  the  tiro  stations.  For  this  case  Z has  density 


2 2 (r  2 2 1 f f-l  1 

f(xj^,X2)  = (x^'+Xg)  expj-cj^x^  + (xj^  + Xg  )J  I cosj^tan  (x2/xj^)/2j 


for  x^  > 0 and  Xg  > 0 . Observe  that  in  this  particular  case  the  components 

of  the  random  vector  Z are  not  Independent.  As  mentioned  earlier,  all  of 
this  work  will  be  reported  in  Harrison  (1977). 

Finally  we  want  to  call  attention  to  the  forthcoming  work  of  Reiman  (1977) 
on  heavy  traffic  approximations  for  open  netmrks  of  queues . The  model  con- 
sidered in  Reiman  (1977)  is  a generalization  of  the  classical  opan  Markovian 
network  modal  of  Jackson  (1957)*  Specifically,  there  are  N nodes  with  node 
i having  a single  server,  a first-come-first  served  queue  discipline,  and  a 
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waiting  room  of  unllmltad  capacity.  Tha  axtamal  Input  atraam  to  noda  1 
la  a ranaval  procaaa,  tha  Intar-arrlval  tlmaa  In  this  procass  having  maan 
and  flnlta  varlanca.  Thasa  axtamal  Input  atraama  at  tha  various 
nodas  ara  asaumad  to  ba  Indapandant.  Tha  aarvlca  tlmaa  at  noda  1 ara  In- 
dapandant  and  hava  a conmon  distribution  with  maan  ^ and  flnlta  varlanca. 
Tha  aarvlca  tlmas  at  noda  1 ara  also  Indapandant  of  tha  customar  arrivals 
at  noda  1 . A customar  laavlng  noda  1 la  Imnadlataly  and  Indapandantly 
routad  to  noda  J with  probability  p^^  ; and  tha  customar  daparta  tha  ays* 


tam  from  noda  1 with  probability  dj  ■ 1 "iJPii  • matrix  P a (p 

* . • *.  J 


IJ 


la  callad  tha  switching  matrix.  Observa  that  this  systam  Is  quite  ganaral, 
encompassing  tha  tandem  system,  acyclic  networks  of  Gl/c/l  queues,  and  net- 
works of  GI/g/1  queues  with  feedback.  ‘Hie  state  of  the  network  at  time 

t > 0 Is  tha  N-vactor  H(t)  whera  the  1th  component  of  H(t)  Is  tha  total 

ntunbar  of  customars  at  noda  1 at  tlma  t 

The  notion  of  traffic  Intensity  for  this  systam  Is  developed  as  follows. 
Let  \ ■ (Xj^,  \2,  . . . > \^)  «nd  let  S - (a^,  ^ 
row  vector  solution  of  the  equation 


a a a 


, ) be  the 


A A A 

a • \ + a P . 

A 

Since  tha  network  Is  open  It  follows  that  each  entry  of  the  matrl.'c  P con- 
verges to  0 as  n m . Thus,  the  matrix  I - $ Is  Invertible  and  tha 
aquation  (d)  has  a unlqua  solution  for  a given  'x  . Intuitively,  the  equation 

A 

(d)  la  a balance  aquation  In  which  Is  Interpreted  as  the  total  long-run 

average  arrival  rata  to  noda  1 when  tha  system  Is  stable.  And,  It  Is  plausible 
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t 


> 


Chat  Che  sysCen  will  be  stable  If  Che  traffic  InCenslCy  Is  less  chan  one  ac 
each  node,  l.e.,  if 


0 


i 


Sf/Ui 


< I 


for  i«I,2,  ...,N  . 

A major  result  to  be  reported  in  Reiman  (1977)  is  a heavy  traffic  limit 

theorem  for  the  time -dependent  behavior  of  the  queue-lengths  vector  process 

H( * ) as  1 for  each  i ■ 1,  . . . , N . This  result  is  for  a sequence 

of  networks  of  queues  as  described  above,  and  generalizes  Che  result  (5)  and 

ocher  results  from  Iglehart  and  Whitt  (1970b)  for  acyclic  networks  in  heavy 

traffic.  The  limiting  process  obtained  is  a N-dimensional  diffusion  D(*) 

whose  state  space  is  Che  non -negative  orthanC.  On  Che  interior  of  the  state 

space  D(*)  behaves  as  a Brownian  motion  in  N-dimensions  with  specified  drift 

coefficients  and  covariance  matrix.  The  covariance  matrix  depends  on  Che 

^leMm  AND 

switching  matrix  and  the  underlyingj(varlances  of  the  inCararrival  times  in 
the  external  input  streams  and  Che  service  times  at  the  various  nodes ^ 

For  the  boundary  behavior  of  the  diffusion  D(*)  , there 

is  instantaneous  reflection  on  each  boundary  surface,  Che  angle  of  reflection 
being  constant  for  each  boundary  surface  but  different  for  each  surface.  The 
angles  of  reflection  depend  only  upon  Che  switching  matrix.  Ocher  properties 
of  Che  diffusion  D(*)  , along  with  other  results  as  well,  are  to  be  reported 

in  Reiman  (1977). 
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3 .0  CLOSED  SYSTEMS 

In  this  section  we  discuss  some  approximation  results  for  closed  Marko- 
vian networks  of  queues.  Our  discussion  is  based  on  work  of  Iglehart  and 
Lemolne  (1973)#  (197^)/  Lureau  (197^)#  ^nd  Iglehart  and  Lalchandani  (1973)« 

For  closed  Markovian  systems  some  approximation  results  are  available  for  the 
equilibrium  distribution  of  the  vector  of  queue-length  processes  at  the  various 
nodes,  when  the  number  of  customers  in  the  system  and  the  number  of  servers  at 
each  node  are  large;  and,  in  this  same  setting,  some  approximations  for  time- 
dependent  behavior,  via  diffusion  processes  without  boundaries,  have  been  de- 
veloped. The  most  general  closed  Markovian  system  to  which  available  approxi- 
mation results  on  equilibrium  distributions  can  be  applied  is  the  model  of 
Posner  and  Bemholtz  (1968),  ;diile  the  most  general  closed  Markovian  system 
to  which  available  results  on  diffusion  approximations  can  be  applied  in  the 
model  of  Gordon  and  Newell  (I967).  However,  in  order  to  illustrate  clearly 

both  the  nature  and  the  usefulness  of  the  available  results  we  will  discuss 

them  in  the  context  of  a "repairman  model"  which  is  a special  case  of  the  sys- 
tems studied  in  [21]  and  [5^]. 

3.1  A Repairman  Model 

The  model  which  serves  as  the  basis  for  our  discussion  throughout 
this  section  is  a generalization  of  the  classical  repairman  problem  (cf.  Barlow 
(1962)).  The  model  consists  of  n operating  units  which  are  subject  to  fail- 
ure according  to  an  exponential  distribution  with  parameter  \ > C . These 

operating  units  are  backed  up  by  m^  spare  units  which  can  be  used  to  replace 

any  of  the  operating  units  that  fail.  At  most  n units  can  be  operating  at 
a given  time.  Two  types  of  failure  are  possible.  With  probability  p a failure  of 
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type  one  occurs  and  the  failed  unit  requires  service  from  repair  facility  1 

which  operates  as  a standard  - server  queue  with  exponential  service 

time  distribution  having  parameter  > 0 . Similarly,  with  probability 

q » 1 - p the  failed  unit  goes  to  facility  2 which  has  s ^ servers  and 

n 

exponential  service  time  distribution  with  parameter  Ug  ^ 0 • Th*  flow  of 

units  in  the  system  is  shown  in  Figure  5*  One  interpretation  of  this  model 


FIGURE  5 - REPAIRMAN  MODEL 


is  that  failures  of  type  one  are  minor  and  can  be  repaired  at  a local  repair 
while  failures  of  type  two  are  major  and  require  service  at  a cen- 
tral repair  facility. 

(t)  denote  the  number  of  units  waiting  and  undergoing  repair 
at  facility  k « 1, 2 at  time  t > 0 , and  then  let 
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If  Y (t)  denotes  the  number  of  operating  units  at  time  t , then  Y (t)  ■ 
a * (t)  + (t)  - m^J  , where  x s niax(x,0)  . Thus,  the  two-dimen- 
sional vector  is  a meaningful  description  of  the  state  of  the  system 

at  time  t . Since  the  repair  and  failure  distributions  are  exponential 
the  process  Cx  (t),  t > O)  is  an  irreducible  positive  recurrent  Markov  chain 

^ "y  \ 


/ \ 

finite  space  Aj^a||jj:i>0  , j>0  , i+j<n  + m^|  , 


depicted 


in  Figure  6.  We  distinguish  four  regions  of  the  state  space  and  these  are 


labeled  A , B , C and  D in  Figure  6, 
n n n n 


FIGURE  6 - STATE  SPACE  FOR  X (•) 


The  Inf laic as ima I perameCers  of  Che  process  X^(')  developed  as 

follotn.  For  5 In  ^ leC  q(&)  denoce  Che  CoCal  cranslclon  race  ouC  of 
scace  & and  q(3,  8 ) Che  cranslclon  race  from  scaCe  8 Co  sCaCe  8*8.  LeC 

e^  ■ and  ®2  " (i)  * ^ then  Che  nexc  cranslclon  will  be 

elcher  Co  sCaCe  ^ (failed  unlC  arrives  ac  faclllCy  k ) or  Co  sCaCe 

8 - (repaired  uniC  leaves  faciliCy  k)  for  k ■ 1,  2 . Thus,  for  sCaCe 

5 we  have 


q(8)  - q(8,  8 + e^)  + q(8,  8 + e,)  + q(S,  8 - e^^)  + q(8,  5 - e^) 

where  q(8,  8 ) ■ 0 If  8 is  noc  in  A • Table  1 gives  Che  InflnlCeslmal 

n 

paraoecers  for  Che  four  regions  of  Che  sCaCe  space  deplcced  In  Figure  6, 

where  x A y ■ min(x,  y)  . 

We  wane  Co  approxlmaCe  Che  behavior  of  Che  process  X^( * ) when  n Is 
large.  These  approxlmaClons  Cake  Cwo  forms.  In  Che  flrsc  case  we  approxlmaCe 
Che  equilibrium  or  llmlclng  behavior  of  Che  process;  as  we  will  see,  Chls  equi- 
librium dlscribuclon  Is  dlfflculc  Co  work  wlch,  buC  simple  approxlmaClons  can 
be  derived  which  yield  much  useful  InformaClon.  In  Che  second  case  we  approxl- 
maCe Che  process  (X  (c),  C > O)  ICself  by  an  approprlaCe  diffusion  process; 

n 

Chase  diffusion  approxlmaClons  are  perhaps  Che  only  way  of  obcalnlng  useful 

resulcs  on  Che  clme-dependenc  behavior  of  Che  sysCem.  The  resulCs  we  describe 

1 ^ 

are  derived  under  Che  assumpclon  chac  Che  paramecers  s^  , s^  and  m^  grow 
linearly  wlch  n . Specifically,  as  n -» « ic  is  assumed  chac 

“n'~“*k  " 0<%<1  » k-1,2  (9) 
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eglon 


and 


m~nm,  m>0 
n ’ 


The  results  obtained  are  In  terms  of  the  seven  independent  parameters  In  the 


model  besides  n : X , p,  s^^,  a^,  ^2#  ® 


3.2  Approximating  the  Equilibrium  Distribution 

Let  us  denote  by  | j ^ i ( j ) ® | equilibrium  on  limiting 

distribution  of  the  process  X^( • ) . This  equilibrium  distribution  can  be 

obtained  from  the  results  of  [21],  but  since  ^q(*)  also  a reversible  com- 
petition process,  see  Iglehart  (196h),  a more  straightforward  description  of 
this  distribution  is  possible.  Accordingly,  let  ■ 1 , and  for  i + j > 0 

let  7^°^  be  a ratio  of  products  of  infinitesimal  parameters  defined  as  follows , 
The  numerator  of  7^^^  is  the  product  of  parameters  q(5,  5 ) for  states  5 
and  S along  the  path  (in  the  plane)  from  state  to  state  | ^ j which 

proceeds  horizontally  from  state  to  state  and  then  vertically 

from  state  to  state  j . Similarly,  the  denominator  of  7^“^  is 

a product  of  parameters  q(5,  S ) for  states  5 and  5 along  the  same  path 

from  to  but  in  the  opposite  direction.  Letting 


we  then  have 


-E 
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4* 


"if  - 


for  each 


In  A 


It  la  rather  obvious  that  for  large  n the  probability  distribution  defined 
by  (11)  Is  tedious  to  calculate  and,  more  Importantly,  difficult  to  use  In  draw- 

t 

Ing  qualitative  conclusions  about  overall  system  behavior.  It  Is  helpful,  there- 
fore, to  have  simple  and  useful  approximations  for  this  distribution.  Such  approxi- 
mations were  obtained  In  Iglehart  and  Lemolne  (1973)^  (19T^)*  And,  some  of  these 
results  were  refined  and  extended  In  Lureau  (197^)^  Che  extensions  Including  approxi- 
mations for  the  more  general  closed  network  model  of  Posner  and  Bemholtz  (I968). 

We  nQ;w  give  a sample  of  the  results  from  [30],  [3II  end  [k^]  for  the  model  of  Figure  5 


In  what  follows,  let  X * ( p ) be  a random  vector  having  the  dlstrl- 

° vJ 

butlon  defined  by  (11).  We  can  thus  regard  X^  as  the  number  of  units  at 

repair  facility  k under  equilibrium  conditions.  Then,  let  « n - 
10  ^ 

[X  *>■  X - m ] denote  the  number  of  operating  units  under  equilibrium  con- 
n n n 

ditions.  Let  a^  ■ , «2  “ " (a^)  ' let 


Finally,  let 


^(<)  denote  a Poisson  random  variable  with  parsaetar  < and  N(M,  £)  a 
random  vector  having  a bivariate  normal  distribution  with  mean  vector  M and 
covariance  matrix  Z . 

The  first  result  wa  give  Is  perhaps  the  tsost  favorable  one  from  the  stand- 
point of  an  operational  systaa.  Both  repair  facilities  are  operating  In  light 
traffic  and  an  asqila  number  of  spares  are  available. 


t 


Thus,  If  «•  have  a light  traffic  condition  at  each  facility  (a^  < 

and  *2  *2^  *“  ample  supply  of  spares  (a^^  + a^  < m)  , then  with 

high  probability  no  queues  form  at  either  facility  and  n units  are  in 

1 2 

operation.  Note  that  and  are  asymptotically  Independent,  so  that 

the  two  facility  model  in  this  case  behaves  exactly  like  two  Independent  one 
facility  models.  Moreover,  X^  has  a distribution  which  Is  approximately 
normal  with  mean  n a^^  and  variance  n a^  for  k a 1 , 2 . 

The  next  result  we  present  describes  a situation  which  Is  far  less  satis- 
factory from  an  operational  standpoint.  In  the  case  we  consider,  facility 


.1(2)  is  in  heavy  (light)  traffic.  Let  v » (l  + a2)/a^  , y • , 

, n ♦ m - s V \ 

( 7 j • 


If  a^  > s^  , a^  < Sg  , s^v  <1  , and  Sj^  + Sg  < m , then 

- [l  - o(n"^/^)j  (ny)  a n + m^  - 1 - 

X p|^  (nyag)  a J j. 

^ (j)  ^ 

and  the  terms  o(n~^^^)  are  uniform  over  A'*'  ; and 


11m  P 


K*<} 


1 . 


In  addition  to  the  tuo  results  presented  above,  a comprehensive  set  of 
cases  for  the  model  of  Figure  5 Is  considered  In  [^1]  and  cbls 

Includes  the  Interesting  case  where  both  facilities  are  in  light  traffic  but 
fewer  than  n units  are  operating,  a circumstance  In  idilch  providing  more 
spares  does  result  in  having  more  units  operational. 

Thus,  we  see  that  while  the  model  of  Figure  5 does  have  an  unwieldy 
equilibrium  distribution,  this  distribution  does  admit  simple  approximations 
which  provide  useful  Information  cU>out  system  behavior. 

5.3  Diffusion  Approximations 

The  time-dependent  behavior  of  the  Markov  chain  {X^(t),  t > o)  is 
virtually  impossible  to  analyze  In  a direct  manner.  It  does  turn  out,  however, 
that  as  n 00  the  process  ^q(*)  with  appropriate  time  and  state  scales 
does  converge  in  distribution  (or  weakly)  to  a limiting  diffusion  process.  The 
particular  dlff^I3lon  process  of  interest  here  is  the  bivariate  Omsteln-Uhlenbeck 
process  (b.O.U).  The  diffusion  approximations  we  will  describe  follow  from  more 
general  results  in  Iglehart  and  Lalchandanl  (1973)  on  the  convergence  of  Markov 
chains  In  discrete-time  and  In  continuous -time  to  the  multi -variate  Omsteln- 
Uhlenbeck  process.  These  diffusion  results  In  Iglehart  and  Lalchandanl  (1973) 
were  derived  by  heuristic  argxments,  but  using  methods  to  be  reported  In 
Varadhan  (1977) > ^ke  results  can  now  be  rigorously  Justified.  Moreover,  these 
results  can  be  applied  to  obtain  dlffxision  approximations  for  the  network  model 
of  Gordon  and  Newell  (I967). 

Before  giving  a sample  of  the  approximation  results  for  the  model  of  Figure 
3,  we  provide  a brief  description  of  the  b.0.I7.  process;  for  further  details 
see  Schach(1971)^  Iglehart  and  Lalchandanl  (1973);  ^d  Arnold  (197^).  If  we 
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say  that  {Y(t),  t > o)  la  a b.O.U.  process  we  mean  that  Y(*)  is  a two- 
dimensional  Markov  process  having  continuous  sample  paths  and  stationary 
transition  probabilities,  and  for  which  there  are  real  2x2  matrices  A 
and  B , with  A s}nimetrlc  and  positive  definite,  such  that 

ti(t)  s ECY(t))  a e"®^E(Y(0)}  , 

t 

Z(t)  3E|[YCt)  - ^i(t)][Y(t)  - u(t)]'}  » f e’®*Ae"®'*dz  , 


and  the  conditional  distribution  of  Y(t  + s)  given  Y(s)  is  the  bivariate 
normal 


N(e’®S(s)  , Z(t)j 


for  all  t,  s > 0 ; the  symbol  * denotes  transpose  and  all  vectors  are 


taken  to  be  column  vectors . If  the  eigenvaliies  of  the  matrix  B have  strictly 

-Bt 


positive  real  parts,  then  e -»0  as  t-»oo  ,so  that  n(t)  -» 0 as  t -♦ » 
and 


t oo 


I 


C = lim  Z(t)  * / e A e ® * dz  ; 


the  matrix  C is  symnetrlc  and  positive  definite  and  is  the  unique  solution 
of  the  matrix  equation 


3' 


I 


BD  + DB'  ■ A . 


Moreover,  In  this  case 


Z{t) 


-at 


and  Y(t)  converges  in  distribution  (as  t ^ as)  to  the  bivariate  normal 
K(0,  C)  . In  the  examples  we  consider,  the  matrix  B will  indeed  have 
eigenvalues  with  strictly  positive  real  parts. 

The  matrices  B and  A are  related  to  the  Infinitesimal  mean  and  the 
infinitesimal  covariance  of  the  process  Y(*)  in  the  sense  that  for  any  vector 
y and  for  any  t > 0 

lim  h’^E{Y(t  + h)  - Y(t)I  Y(t)  - y)  - -By 
h-40 


and 


lim  h'^  E|[yCt  + h)  - Y(t)I  (Y(t  + h)  - Y(t)]'|Y(t)  » y}  - 


A . 


h-aO 


In  order  to  obtain  a diffusion  limit  for  the  model  of  Figure  5,  under 
the  assumptions  (9)  and  (lO),  ve  form  the  sequence  of  processes  / 

n ■ 1,  2,  . . . } where 


X (t)  - ng 
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r. 


I 


-I 


for  t > 0 iuoid  g is  a fixed  two-dimensional  vector  selected  so  that  the 

infinitesimal  mean  and  covariance  of  the  process  (Y^(t),  t > o)  converge 

as  n-»oo  to  those  of  appropriate  b.O.U.  process  (Y(t),  t > o)  . We  then 

approximate  the  behavior  of  X^(t)  by  that  of  n^/^(t)  + ng  when  n is 

large.  The  vector  ng  should  be  an  "equilibrium  point"  of  the  Markov  chain 

X^( * ) in  that  the  chain  should  drift  toward  n g . in  the  notation  of 

Section  3*1^  tbe  vector  ng  lies  within  the  triangle  defined  by  a when 

n 

n is  large,  and  satisfies  asymptotically  the  balance  equations 


q([ng]  j [ng]  + e^^)  = q([ng]  , [ng]  - 


^ <!(  tog]  ) tag]  + eg  ) = q([ng]  , [ng]  - eg) 

r.  /^^iM 

as  n -» oa  f where  [ng  ] » I 1 for  g s 

\[ng2]^ 

We  now  give  the  diffusion  analog  for  the  first  result  of  Section  3*2; 

we  refer  back  to  that  result  for  the  definition  of  various  quantities  which 

appear  below. 

X. 

Let  g ■ a and  suppose  that  X^(0)  ■ [ng]  . If  a^^  < Sj^  , *2  ®2  ^ 

Sj^  + Sg  < m , then  for  every  t > 0 
K 
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Given  the  relationship  among  the  basic  system  parameters  in  the  above, 

the  vector  ng  lies  in  the  region  of  Figure  6 for  n large,  and  thus 

so  does  X^(0)  . From  (12)  we  see  that  X^(t)  (or  n^'^^Y(t)  + ng)  has 

1/2 

fluctuations  about  n g of  the  order  n ' ; but,  the  distance  from  the 

boundaries  of  region  A to  the  point  ng  is  of  the  order  n . Thus, 

n 

the  process  (X^(t),  t > O}  never  leaves  the  region  A^  with  any  appreciable 
probability.  Since  na^  -f  na^  ^ ^ therefore  see  that  for  large  n 

there  are  n units  in  operation  at  time  t with  high  probability.  Since  the 
matrix  C has  zero  off-diagonal  elements,  the  component  processes  (xj'(t},  t > O) 

UO 


3 


2 

atid  (x^  (t),  t > 0}  are  asymptotically  Independent.  Each  component  process, 
appropriately  normalized,  converges  to  a univariate  Omsteln-Uhlenbeck  process. 
Hence,  for  large  n , xj*  (t)  has  a distribution  which  is  approximately 
/ ”^1^  .\  2 

Nl n a^  e , naj^(l  - e 'j  and  X^  (t)  has  a distribution  which  is  approxl* 

mately  normal  N(na2e  , na2(l  - e ))  * t in  (12),  we 

find  that  (X^  - n g)/n^^^  N(0,  C)  , in  agreement  with  the  first  result  of 

Section  3*2. 

The  next  result  we  present  is  the  diffusion  analog  of  the  second  result 


from  Section  3*2.  We  refer  to  that  result  for  the  definition  of  varloxis  quantl 
ties  which  appear  below. 


Let  g ■ o and  suppose  that  X^(0)  ■ [ng]  . If  t *2  ®2  * 

Sj^v  <1  , sad  8^  + Sg  < m , then  for  every  t > 0 


k 


and  C « A . 

Given  the  relationship  among  the  basic  system  parameters  in  the  above, 

the  vector  ng  lies  in  the  region  of  Figure  6 when  n is  large.  Thus, 

the  process  (z  (t),  t>ol  never  leaves  C with  any  appreciable  probability, 
n ■“  n 

Facility  1 is  saturated  while  facility  2 is  stable,  and  far  fewer  than  n units 
are  operating.  Additional  spares  are  of  no  help  in  alleviating  congestion;  in 
fact,  they  only  exacerbate  an  already  undesirable  situation.  Letting  t -»os 
in  (13)  we  see  that  (X^  - ng)/n^'^^  N(0,  C)  , in  agreement  with  the 

second  result  of  Section  3*2.  Thus,  for  n large  and  t large,  the  number 
of  operating  units  has  a distribution  which  is  approximately  N(ns^/a^,  ns^/a^)  . 

Finally,  we  remark  that  the  diffusion  approximations  given  here  form  a 
small  saiqple  of  the  results  from  the  paper  of  Iglehart  and  Lalchandani  (1973). 

In  addition  to  the  system  of  Figure  5^  the  paper  also  provides  diffusion  limits 
for  other  repair  systems,  as  well  as  the  general  results  on  weak  convergence 
of  Markov  chains  mentioned  above. 


U.O  S(»1E  OPEN  PROBLEMS 


In  this  section  we  cite  some  open  problems  In  the  area  of  approximation 
results  for  networks  of  queues.  Given  the  complex  nature  of  queueing  net- 
works and  the  available  approximation  results  which  have  been  discussed  In 
Sections  2 and  can  compose  a rather  long  list  of  open  problems  In  the 

area.  There  are,  however,  a certain  few  problems  which  seem  to  merit  care- 
ful study,  and  we  will  now  discuss  these  In  separate  numbered  paragraphs. 

1.  Consider  a closed  network  model  of  the  sort  Introduced  by  Gordon 
and  Newell  (19^7)  but  with  arbitrarily  distributed  service  times.  There  are 
no  general  results  available  for  such  systems,  save  some  equilibrium  results 
and  some  occupation- time  results  for  a few  special  cases.  It  would  there- 
fore be  helpful  to  develop  diffusion  approximations  for  closed  systems  with 
arbitrarily  distributed  service  times  In  the  spirit  of  those  obtained  by 
Iglehart  and  Lalchandanl  (1973)  closed  Markovian  systems. 

2.  The  limiting  diffusion  approximations  which  have  been  developed  for 
open  networks  Involve  complicated  functionals  of  multl-dlmenslonal  Brownian 
motion.  Except  In  the  case  of  single-node  systems,  however,  there  are  as 

yet  no  computationally  tractable  approximations  of  general  applicability  which 
have  been  extracted  from  these  diffusion  limits  for  multi-node  systems . In 
particular,  first-passage  or  occupation- time  distributions  are  as  yet  unavail- 
able for  these  limiting  diffusion  processes.  Thus,  further  work  Is  necessary 
In  order  to  make  existing  results  more  useful  for  answering  a variety  of  ques- 
tions which  arise  In  the  contexts  of  system  design  and  system  control. 

3.  With  few  exceptions,  the  qtxeuelng  theory  literature  Is  concerned  with 
systems  whose  arrival  rates  (distributions)  and  service  rates  (distributions) 


^ 1 

I, 

do  not  vary  with  clna.  It  would  be  very  interesting,  for  example,  to  de- 
velop a diffusion  limit  for  an  open  network  model  of  the  sort  introduced  by 
Jackson  (1957)  but  for  which  the  external  input  streams  are  non- stationary 
Poisson  processes  having  rate  functions  which  are  periodic  (as  functions  of 

time) . 

i. 
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